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Electronic Display with Compensation for Shaking 
Field of the Invention 

The present invention relates generally to electronic display devices, and more 
particularly to compensating the output while shaking the devices. 

Background of the Invention 

Numerous techniques are known to detect shaking in cameras and to stabilize the 
acquired images when shaking is detected. Many of these techniques use 
accelerometers. U.S. Patent 5,448,510 "Camera shake detection apparatus" issued to 
Murakoshi on May 15, 1984 sounds an alarm when excessive shaking might result in 
a blurred image. U.S. Patent 5,758,202 "Camera capable of reducing image blur" to 
Amanuma et al. issued on May 26, 1998. Accelerometers have also been used to 
prevent damage due to shaking in disk drives in portable computers, U.S. Patent. 
Other systems where vibrational noise is reduced include towed sensor arrays, U.S. 
Patent 5,528,555. All of these devices deal with the problem of reducing noise due to 
shaking in input type of devices. 

There is also a need to reduce effects due to shaking in output devices such as 
electronic displays, e.g., CRTs, LCD panels, LEDs, plasma displays, and the like. 
Particularly now that a large number of these devices are used in mobile electronic 
appliances such as cellular phones laptops, hand-held computers, digital display 
devices in cars, buses, trucks, planes, and boats. It is difficult to read these displays 
under shaky conditions. 
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Therefore, there is a need for apparatus and methods for testing the shock and 
vibrational loads imposed on display devices and to compensate for this shaking. 
This need exists particularly for display devices used in mobile electronic appliances. 

Summary of the Invention 

A display device includes a display screen, and horizontal and vertical display 
signals. The horizontal and vertical display signals are used to render an image on the 
display screen. A first and second accelerometers are mechanically coupled to the 
display screen. First and second compensation circuits convert acceleration in 
horizontal and vertical directions respectively to x- and y-compensation signals. First 
and second adders combine the x- and y-compensation signals with the horizontal 
and vertical display signals to dynamically adjust a location of the image on the 
display screen while the display device is subject to movement. 

In a first embodiment, the display signals are deflection signals of a cathode ray tube 
and the compensation circuits operate in an analog mode. In a second embodiment, 
the display signals are address signals of a digital display panel, and the 
compensation circuits operate in a digital mode. In a third embodiment, a predictive 
controller is included, to model and anticipate the movement of the display device. 

Brief Description of the Drawings 

Figure 1 is a block diagram of a display device according to a first embodiment of 
the invention; 
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Figure 2 is a block diagram of a display device according to a second embodiment of 
the invention; 

Figure 3 is a block diagram of a display device according to a third embodiment of 
5 the invention; and 

Figure 4 is a flow diagram for a predictive method used by the device of Figure 3. 

Detailed Description of Preferred Embodiments 

10 

Figure 1 shows a preferred embodiment of a display device 100 that compensates for 
|5 shaking and vibration. The display device is particularly suited for use in mobile 
Ji; environments, or in environments where there is a lot of vibration, for example 

display systems integrated into industrial machinery. 

>s 

C The display device 100 according to the invention includes a cathode ray tube (CRT) 
101 that can display an image 102. The image is generated via horizontal and vertical 

G deflection circuits 103-104. The deflection circuits can be derived from television 
signals, e.g., NTSC or HDTV, or via a display buffer and a graphics generator in a 

20 computer system, not shown. 

The invention corrects for the shaking or vibration by using an x-motion 
compensation circuit 10 for a horizontal deflection signal (H in ) 105, and a y-motion 
compensation circuit 11 for a vertical deflection signal (Vi„) 106. Each motion 
25 compensation circuit performs in a like manner. 
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The compensating signals are respectfully derived from accelerometers 1 10. The x- 
and y-accelerometers are mounted at right angles to each other and are coupled in a 
fixed relationship to the display screen. For example, they are mechanically attached 
to the display device 101, or the housing in which the CRT is mounted so that motion 
can be directly detected. The accelerometer can be implemented using the ADXL- 
202 from Analog Devices, Inc. 

The output from each accelerometer 1 10 is passed through a first band-pass filter 
1 12. The purpose of the first filter is to prevent signal drift due to zero-point (DC) 
errors. Therefore, the low-end cut-off of the band-pass filter blocks any frequencies 
less than one half cycle per second. Also, since the refresh rate for the image is 
typically limited to 30 or 60 frames per second, the high end cut-off of the filter 
blocks frequencies higher than the image refresh rate. 

Next, the filtered signal is presented to a first integrator 1 14. The first integrator 
derives velocity from acceleration. The output from the first integrator can be passed 
through a second band-pass filter 1 16, particularly if a finite precision integrator is 
used. The output of the second integrator is presented to a second integrator 1 18 to 
derive position from velocity. The output of the second integrator can be passed 
through a third band-pass filter 120. The second and third filters can be like the first, 
and perform like functions, that is, to filter drift and low-frequency noise, and to have 
the sampled signal not exceed the Nyquist frequency of the display device. 

The outputs of the third filters can be passed through optional gain control circuits 
122 to respectively form x- and y-compensation signals (H delta , V delta ) 107-108. The 
compensation signals are combined with the deflection signals in adders 126. The 
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compensated deflection signals (H out , V out ) are fed directly to the deflection coils 130 
of the CRT 101. 

The net effect of the compensation circuits is to hold the image 102 stable, with 
respect to the viewer 109, while the display device is shaken or subject to vibration 
such as is experienced in mobile applications or vibrating environments. 

It should be noted that an additional z-motion compensation circuit can be added to 
account for shaking in the z-direction. In this case, the angular extent of the image, as 
perceived by the user, is held steady by adjusting the vertical and horizontal size 
signals as the display moves in and out. 

In an alternative embodiment for digital devices, a display device 201 is a LED array 
or a LCD panel. In this type of display, pixels in a display memory 250 are selected 
by x- and y-address select signals derived from a digital processor 240. The 
compensation circuits here include accelerometers 210. The outputs of the 
accelerometers are converted to digital signals by the AID converters 220. The 
remainder of the compensation circuits 220 operates as described above, except now 
using digital circuits to filter and integrate acceleration to obtain distance. The 
compensating x and y signals 207-208 are respectively added 330 to the select 
signals 241-242 to correctly address the display memory with motion compensation. 

For example, if a pixel at [73, 107] would be the next pixel addressed under a steady 
state condition, and motion has caused the display to move by [+3, +5] pixel units, 
then the compensated address select signal is [76, 112]. That is, in general: 

x 0 ut = *in + Xdeua and y out = y in + y delta , 
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where the delta values are the amount of motion. It may be necessary to interpolate 
between pixels when the movement is a fractional pixel distance. 

Predictive Methods for Compensating for Shaking Displays 

5 

If the vibration is periodic, then it is possible to predict where the display will be 
located in near future times. Thus, it becomes possible to predetermine the 
compensation signals for a next frame while displaying a previous frame. 

10 High Duty Cycle Displays 

J: High duty cycle displays are those where each pixel is illuminated for most or all of 

: i: the frame time. These include LCD and plasma displays. Using the accelerometer 

/; signals and a prediction method, first predict the relative display offset for the next 

11 frame time, see below for details on the predictive method. Translate the image in the 
C frame buffer by the negative of this offset. It is best if the translation is performed on 

a sub-pixel basis, but this may be computationally expensive. Otherwise, round the 

r; offset to the nearest integer number. 

20 Low duty cycle displays 

Low duty cycle displays are those where each pixel is illuminated for only a small 
part of the frame time. Such displays use the "persistence of vision" of the human 
eye to make the display seem to be continuously illuminated. These include LED 
25 displays. Using the accelerometer signals and the predictive method, first predict the 
relative display offset for the next frame time. Next, calculate when during the frame 
time the display will pass nearest to an even pixel boundary. Shift the frame buffer 
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data by the appropriate offset to compensate for this. At the calculated instant, 
illuminate the display, usually by flashing the LEDs for the low duty cycle. This 
method can provide the effects of sub-pixel shifting without the computational 
expense of the calculation. 

5 

Figure 3 shows the embodiment where a predictive controller 320 is used to 
dynamically generate adaptive correction signals 307-308. In this case, the output of 
the compensation circuits 310, 320 is presented to the predictive controller 320. The 
signals are stored in a memory 321. The signals are analyzed over time to build a 

10 model 322 that predicts anticipated motion. This is particularly useful where the 
motion is repetitive, or faster than the refresh rate of the display device 301 because 

jjj in this case, the compensation signals 307-307 for the adders 304-305 can be 

% adjusted ahead of time using the model 322. 

Is Predictive Method 

W Given that the shaking can be expressed as a bandlimited signal composed of 
□ multiple sinusoids and possibly noise, the following method, as shown in Figure 4, 
allows the controller 320 to predict compensation signals for near future times. 

20 

In step 410, sample the bandlimited shaking signal 401. The sampling rate should be 
at least twice the highest frequency in the shaking signal in order to comply with the 
Nyquist sampling theorem. Collect at least N samples, where TV is the sampling rate 
times the reciprocal of the lowest frequency of the bandlimited signal. Multiply the 
25 samples by a proper window function, such as a raised cosine. 

In step 420, perform a discrete Fourier transform (DFT) on the windowed samples. 
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In step 430, convert the transformed samples, which are complex numbers, into polar 
coordinates. This yields the magnitude and phase of the spectrum of the original 
signal. 

In step 440, locate all spectral peaks whose magnitude is above some predetermined 
threshold. The threshold can be chosen to be smaller than the allowable error of the 
desired prediction. If the noise statistics of the original samples are known, then the 
threshold should be set to be above the noise level at each bin to minimize the effect 
of the noise on the peaks. Label these peaks 1 through M. 

In step 450, for each peak, find its magnitude "/?", phase "0" and frequency "f\ If the 
noise statistics of the original samples are known, then estimate the values of "p," 
"0," and using standard probabilistic techniques such as Maximum Likelihood 
estimation, see Papoulis, Probability, Random Variables and Stochastic Processes, 
McGraw-Hill, Inc., Third Edition, pp. 260 et seq., 1991. Multiply "/?" by a correction 
factor to compensate for attenuation caused by the window function. 

In step 460, using all of the triples "0 and "/", determine: 
x(t) = ^{r, xcos(2x^rx/ z x* + 0.)}, 

where p h 0 h and/- are the parameters of the ith peak from step 440. The value x(t) 
409 is an estimate of the original signal for times t during and after the original 
collection of samples. Time t = 0 corresponds to the time of the first sample. 

Although the invention has been described by way of examples of preferred 
embodiments, it is to be understood that various other adaptations and modifications 
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may be made within the spirit and scope of the invention. Therefore, it is the object 
of the appended claims to cover all such variations and modifications as come within 
the true spirit and scope of the invention. 
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Claims 

1 LA display device including a display screen, and horizontal and vertical 

2 display signals, the horizontal and vertical display signals to render an image 

3 on the display screen, comprising: 

4 a first and second accelerometers mechanically coupled to the display 

5 screen; 

6 a first and second compensation circuits to convert acceleration in 

7 horizontal and vertical directions respectively to x- and y-compensation 

8 signals; 

9 first and second adders combining the x- and y-compensation signals 

10 with the horizontal and vertical display signals to dynamically adjust a 

1 1 location of the image on the display screen while the display device is 

12 subject to movement. 

1 2. The display device of claim 1 wherein the display screen is a cathode ray 

2 tube and the compensation circuits operate in an analog mode. 

1 3. The display device of claim 2 wherein the display signals are deflection 

2 signals for the cathode ray tube. 

1 4. The display device of claim 1 wherein the display screen is a digital 

2 screen. 

1 5. The display device of claim 4 wherein the display signals are address 

2 signals for a frame buffer of the digital screen. 
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6. The display device of claim 1 wherein each compensation circuit further 
comprises: 

a first and second integrator to convert acceleration to position; and 
at least one band-pass filter. 

7. The display device of claim 6 wherein a low frequency cut-off of the band 
pass filter is less than one half cycle per second, and a high frequency cut-off 
is less than a refresh rate of the display screen. 

8. The display device of claim 1 wherein each compensation circuit includes 
a gain control circuit. 

9. The display device of claim 1 further comprising a predictive controller to 
anticipate the movement. 
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Abstract of the Disclosure 

A display device includes a display screen, and horizontal and vertical 
display signals. The horizontal and vertical display signals are to render an 
image on the display screen. A first and second accelerometers are directly 
coupled to the display screen. First and second compensation circuits 
convert acceleration in horizontal and vertical directions respectively to x- 
and y-compensation signals. First and second adders combine the x- and y- 
compensation signals with the horizontal and vertical display signals to 
dynamically adjust a location of the image on the display screen while the 
display device is subject to movement. 
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DECLARATION AND POWER OF ATTORNEY 



DECLARATION: 



As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are 
as stated below next to my name. 

I believe, the below named inventors are the original, 
first and joint inventors of the subject matter which is 
claimed and for which a patent is sought on the invention 
for ELECTRONIC DISPLAY WITH COMPENSATION FOR SHAKING, the 
specification of which is attached hereto unless the 
following box is checked. 

[_] was filed on > as Application Serial Number > and 
was amended on > (if applicable) . 



I hereby state that I have reviewed and understand the 
contents of the above-identified specification, including 
the claims. 

I acknowledge the duty to disclose information which is 
material to patentability in accordance with Title 37, Code 
of Federal Regulations, D1.56. 

I hereby claim foreign priority benefits under Title 
35, United States Code, ail9(a)-(d) of any foreign 
application (s) for patent or inventor's certificate listed 
below and have also identified below any foreign application 
for patent or inventor's certificate having a filing date 
before that of the application on which priority is claimed: 
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Priority 
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I hereby claim the benefit under Title 35, United States 
Code §119 (e) of any United States Provisional application ( s ) 
listed below. 



APPLICATION NUMBER 


FILING DATE 
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> 



I hereby claim the benefit under Title 35, United States Code, 
§120 of any United States application (s) listed below and, 
insofar as the subject matter of each of the claims of this 
application is not disclosed in the prior United States applica- 
tion in the manner provided by the first paragraph of Title 35, 
United States Code, §112, I acknowledge the duty to disclose 
material information as defined in Title 37, Code of Federal 
Regulations, §1.56 which became available between the filing date 
of the prior application and the national or PCT international 
filing date of this application: 
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I hereby declare that all statements made of my own knowl- 
edge are true and that all statements made on information and 
belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and 
the like so made are punishable by fine or imprisonment, or both, 
under Section 1001 of Title 18 of the United States Code and that 
such willful false statements may jeopardize the validity of the 
application or any patent issued thereon. 



POWER OF ATTORNEY: 

On behalf of Mitsubishi Electric Information Technology Center 
America, Inc., Assignee of my entire right, title and interest, I 
hereby appoint the following attorney with full power of 
substitution to act exclusively for Mitsubishi Electric to 
prosecute this application and transact all business in the 
Patent and Trademark Office connected therewith: Dirk Brinkman, 
Reg. No. 35,460. 



All correspondence should be addressed to: 
Patent Department 

Mitsubishi Electric Research Laboratories, Inc. 
2 01 Broadway 

Cambridge, Massachusetts 0213 9 
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Citizenship : 


United States of America 


Post Office Address: 


2 4 Nash Road 
Acton, MA 01720 
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Darren L. Leigh . 
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Date : 
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